A METHOD AND APPARATUS FOR PRODUCING A HIGH RESOLUTION IMAGE 



Cross-Reference to Related Applications 

This application is a continuation of International 
Application PCT/DK02/00589 filed September 11, 2002, the entire 
content of which is expressly incorporated herein by reference 
thereto . 

Background Art 

The present invention relates to a method and an apparatus 
for producing a high-resolution image. 

Solid state imaging devices such as CCDs (Charge Coupled 
Devices) or C-MOS arrays consisting of imaging surfaces, with 
pixels arranged in a one or two-dimensional matrix are widely 
used in digital cameras and scanners. 

There is however a growing demand for higher resolution of 
the images. One way of obtaining a higher resolution is by 
increasing the number of pixels in the imaging surface of solid 
state imaging devices. However, if the number of pixels is 
simply increased in e.g. a CCD to satisfy the need for high 
resolution, its chip size has to be further increased. On the 
other hand, in order to increase the number of pixels without 
changing the present CCD chip size, the integration of pixels 
must be greatly enhanced. It is technically difficult to 
prepare such a high-density CCD. Even if development of 
improved fabrication techniques allows the manufacture of such 
a CCD in the near future, the circuit configuration for driving 
such a CCD becomes complicated and power consumption becomes 
higher, thus entailing new problems, which will result in loss 
of production efficiency and higher cost. 

Other methods for obtaining higher resolution have been 
used. In scanners the CCD or CMOS array are usually moved in 
one direction in steps equal to the height of the individual 



sensors by means of stepper motors, and in special high 
resolution cameras, the sensor matrix are moved in both an X 
and an Y directions, to move the individual cells to positions 
not covered by any cell in the matrix (due to a physical 
5 distance between each sensor) or to positions not covered by 
either a red, green or blue filtered cell. All methods have the 
limitation that the area of each sensor-cell is limiting the 
achievable resolution . 

In many of these systems, a higher resolution is 

10 ''simulated" by the use of so-called '"sharpening" filters, which 
digitally amplify high frequency components. These filters are 
so-called "Finite Impulse Response" (FIR) filters, which only 
amplify those frequencies limited by the above mentioned 
sensor-cell area, and thereby only increase those high 

15 frequency components, that have already passed the limitations 
of the system anyway. 

US Patent 6,002,810 disclose a method for generating an 
image having an arbitrary number of pixels starting from a 
given digitally image having a given number of pixels. This 

2 0 method does not provide a means for improving the resolution 
and the quality of the image after enlarging will be inferior 
to the original . 

US Patent 4,652,928 relate to a method for improving the 
actual resolution of an image at the time the image is being 

25 established. However, the improvement of the resolution is 
limited by a factor 2 and is effected solely upon movement in a 
horizontal direction. Moreover, as already mentioned the 
achievable resolution is limited by the size of the sensor- 
cells . 

30 WO 97/12483 discloses an array of CCD cameras, which by 

means of micro-motion mechanisms moves the array such that a 
number of images are scanned, thereafter the images are 
combined to form one high-resolution image. It does not. 
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however, disclose a technical solution to create a high- 
resolution image from the scanned images. 

US Patent 5,754,226 discloses a method to generate a high- 
resolution image based on a number of displaced low-resolution 
5 images. However the accuracy of the method requires that no 
frequency components above l/Ph occur to avoid aliasing. To 
efficiently remove frequencies above l/Ph a birefringence plate 
is used which both increases the costs and by removing 
frequencies above l/Ph in the low-resolution image also 
10 excludes the possibility to regenerate information above this 
frequency in the high-resolution image. 

Summary of the Invention 

The present invention now provides a new and improved 
15 method and apparatus that are capable of attaining higher 

resolution and realizing better image quality at a lesser cost 

than for currently known devices and methods. 

According to the invention, a low resolution first image 

is converted to a high resolution second image by means of a 
20 light sensor for receiving incident light radiated from a 

scene, whereby the light sensor is constructed as an array or a 

matrix having a number of cells, each defining a predetermined 

area . 

The method for carrying out this conversion comprises 
25 scanning the first image cyclically a number of times, and 
moving the light sensor simultaneously with the scanning 
stepwise an identical number of times relative to the light 
radiating scene in at least one direction, thereby defining a 
number of subareas, with the total distance covered during 
3 0 movement of the light sensor corresponding to the extent of the 
cell or to the extent of the cell plus a distance defined by or 
to the neighbor cell in the at least one movement direction. A 
representation of the high resolution second image is thus 
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established by calculating the representation of the received 
incident light from the scene at each subarea. 

In this method, the calculations are limited to a minimum 
but the image resolution is only limited by factors such as the 
5 optics and the precision of the positioning mechanism rather 
than by the number or size of each sensor cell. This provides 
the user with the possibility of achieving an extremely high 
resolution which far surpasses that known by any other 
conventional method . 

10 

Brief Description of the Drawing Figures 

The invention will be explained in greater detail below, 
describing only simple idealized exemplary embodiments with 
reference to the drawing, in which: 
15 Fig. 1 shows a sensor cell according to the invention with 

a matrix 16 subareas a in a first and second position, 

Fig. 2a-2c is illustrating the method according to the 
invention in a matrix with one cell-array, 

Fig. 3a-3c is illustrating the method according to the 
20 invention in a matrix with one cell-array but were there is a 
physical distance between the cells in the sensor. 

Fig. 4 is illustrating the method according to the 
invention in a matrix with one cell -array, but where the 
influence of an error is minimized by means of a filter 
25 according to the invention. 

Fig. 5 shows schematically an apparatus according to the 
invention. 

Fig. 6a- 6b shows schematically one embodiment of the 
invention, 

30 Fig. 7a-7b shows schematically another embodiment of the 

invention. 

Fig. 8a- 8b shows schematically a third embodiment of the 
invention. 
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Fig. 9a- 9b shows schematically a fourth embodiment of the 
invention, 

Fig. 10a- 10c shows a fifth embodiment of the invention in 
form of a scanner, and 
5 Fig. 11 shows schematically a sixth embodiment of the 

invention . 

Detailed Description of the Preferred Embodiments 

The calculations representing the received incident light 

10 from the scene at each subarea is advantageously performed by 
means of a computer having a software program for receiving the 
output from the position sensor and on basis of this output 
calculate control values for bringing the light sensor to move 
in a wanted way. If the light sensor for each step is moved a 

15 distance corresponding to the extend of the area covered by the 
cell in the direction of movement, divided with the number of 
scanning times it is possible, due to the overlapping between 
scannings, to have several scannings on the same cell whereby 
the calculations in the cycle and thus the resolution will 

20 become even more accurate. 

By an advantageously embodiment according to the invention 
the light sensor can be stepwise moved by means of at least one 
driver relative to the light radiating scene, the immediate 
position of the light sensor can be recorded by means of at 

25 least one position sensor generating output representing said 
sensor position, said output can be send to a computer having a 
software program for calculating control values on basis of the 
received output, and signals representing the calculated 
control values can be send to the at least one position driver 

3 0 for bringing this to drive the light sensor in such a way that 
the steps of movement as function of the scannings defines a 
predetermined curve in a coordinate system. 
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This predetermined curve can have any appropriate form 
such as a stairway or sinusoidal pattern. Another preferred 
form is a triangle. By choosing a triangle curve the scannings 
can be performed with equidistant timely distances while the 
5 distance between the positions of the light sensor are 
maintained exactly the same. 

In practice, the light sensor can be movable mounted on a 
frame and cyclically moved along this by means of the drivers 
simultaneously with scanning the low resolution first image a 
10 number of times by means of an activator bringing the light 
sensor to scan. 

The values calculated after all predetermined number of 
scannings can advantageously be computed by means of the 
following formula: 

15 

Ia{z) = Vo*A/a(n) - Zla(n) for n=l to a=N, n^z (1) 
where : 

N is the number of subareas into which each cell is split, 

2 0 n is the index for subareas in the sensor cell, 

a is the area of the n'th subarea of the sensor cell, 
Vo is the output signal from the sensor cells, 

la is the computed light radiation received by the subarea a, 
z is the subarea to be calculated, and 
25 A is the total area of the sensor cell. 

This formula is based on the assumption that the output 
from each imaging surface of the individual sensor cells 
arranged in a two-dimensional matrix is in principle a 

3 0 representation of the integration of the light intensity on the 

area of the optical sensor elements: 
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= Jla(a)da. 



and when there is a definite number of subareas a in A, is the 
formula : 

5 

Vo = 5:ia(n) for n=l to N, 

where : 

N is the number of subareas into which each cell is split, 
10 n is the index for subareas in the sensor cell, 

Vo is the output signals from the sensor cells, and 

la is the computed light radiation received by the subarea a. 

The larger the sensor element, the larger Vo will be. It 
15 is necessary, however, that V© be independent of the area of 
the sensor, since a given light intensity always must represent 
the same Vq. Therefore, Vo is scaled in accordance with the 
pixel area, so that: 

20 Vo = Sla(n) for n=l to N, => 

Vo=(l/A)* 5:ia(n)*a(n) for n=l to N, 

where a(n) is the area of the n'th subarea. 

This will of course happen automatically in the sensor via 
25 exposure time and related technique in the sensor, but the 
assumption is important for arriving to formula (1) . 

la for a given subarea z is therefore: 

30 Ia(z) = Vo*A/a(z) - Sla(n) for n=l to n=N, n^z (2) 

where : 
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N is the number of subareas into which each cell is split, 
n is the index for subareas in the sensor cell, 
a is the area of the n'th subarea of the sensor cell, 
Vo is the output signals from the sensor cells, 
5 la is the computed light radiation received by the subarea a, 
z is the subarea to be used for calculation, and 
A is the area of the sensor cell. 

If all subareas have equal area, then A/a(z)=N and (1) can be 
10 written: 

ls,{z) = Vo*N - Zla(n) for n=l to n=N, a^^z (3) 

The formula in (1) can in general work for any subarea in the 
15 entire sensor matrix, meaning that the summation of subareas 
can cover subareas from other sensor cells: 

Ia(z) = Vo*A/a(z) - SlaCn) for n=l to n=N, n^z (4) 
2 0 where: 

N is the number of subareas that the summation includes, 
n is the index for subareas to be summarized, 
a is the area of the n'th subarea, 

Vo is the output signal from one of the sensor cells, which 
25 includes the subarea a(z), 

la is the computed light radiation received by the subarea a, 
z is the subarea to be used for calculation, and 
A is the area of the entire subareas. 

30 Since the method according to the invention is based on 
calculated values, or in some instances on estimated values, 
there will inevitably be generated errors in the calculations. 
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The formula in (4) mathematically describes a digital 
"Infinite Impulse Response" (IIR) filter as it reuse previously 
calculated values. Since these filters may oscillate if they 
are triggered by errors, the filter in formula (4) will in 
5 practical implementations have to be slightly modified or 
followed by another digital filter. Typically this other 
filter can also be described by the formula in (4) . 

In a preferred embodiment, the method comprises a digital 
filter for minimizing the errors. The digital filter can e.g. 

10 use several values from several different set of input values 
and the set of previous calculated output values to compute a 
new output value. This will minimize the influence from errors 
in calculated values or errors in an output value from a sensor 
cell. Different types of filters can be used, but the most 

15 simple type is based on the formula in (2), where each factor 
on the right side is weighted with a predetermined value. 

In a more advanced implementation, these weighting factors 
will be adaptive, meaning that the filter characteristics 
changes based on the content of high frequency components in 

20 the part of the image of the light radiating scene where it is 
actually working. 

In one embodiment of the invention is it assumed that the 
light sensor is formed as a X,Y-matrix, with respectively X*Y 
cells. When the sensor has been moved to a N number of new 

25 positions and a N number of sets of output values from the 
sensor has been stored, a new Xs/YT-matrix with Xs*Yt cells can 
be calculated. The new matrix having a row of X*S cells and a 
column of T*Y cells, giving N<=S*T, and the digital filter as a 
modification of formula (3) can be written in the form: 

30 

la (Xs , yt)= Fv * Vo (x,y) - Sla{Xs -n, yt-m)*F(Xs -n, yt-m) (4) 
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for n=l to n= Xs and m=l to m=yt ; {n,m) ^ (Xs,yt) 
where : 

la (Xs/Ys) is the light radiation value of the Xs,yt element in 
the new Xs , Yt matrix to be calculated, 
5 Vo (x,y) is the sensor output value from the sensor element in 
the chosen scanning position covering the (Xg.yt) subarea, 
Fv is the predetermined filter coefficient related to the 
sensor output value from the sensor element in the chosen 
scanning position covering the (xs,yt) subarea, 
10 Ia(xs -n, yt-in) is previous calculated la values, in the new 
Xs/Yt matrix, 

F(xs -n, ys-m) is the predetermined filter coefficients related 
to the previous calculated la values for subareas in the new 
Xs/Yt matrix, and 

15 n,m is the number of previous calculated la values for subareas 
in the new Xs,ys matrix, in the X and Y direction, 
respectively . 

This digital filter has the advantage that the filter 
coefficients for previous calculated values of la can be 
20 smaller and smaller, thereby ensuring that the influence of 
errors in previous calculated values are minimized. 
Furthermore, these coefficients can easily change value 
dynamically, as high frequency components in the scene change 
from one part of the scene to another, thereby taking the full 

2 5 advantage of the method, where it is needed. 

The method can by another advantageously embodiment 
according to the invention also be carried out in such a way 
that the scanning and the stepwise movement of the light sensor 
are asynchronous in relation to each other in the sense that 

3 0 each new scanning is taken place in a sensor position not 

scanned before whereby an almost infinite high resolution is 
possible by only scanning a sufficient number of times. 
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In another embodiment, the method can include a 
calibration procedure. The procedure can consist of steps to 
move the light sensor to a number of calibration positions by- 
applying known energy values, in terms of current and voltage, 
5 to the at least one driver. At each calibration position a 
signal representing the incident light radiated from the scene 
can be obtained and a reference value representing the distance 
moved by the light sensor can be calculated by comparing the 
different numbers of known energy values with the different 

10 signals representing the incident light radiated from the 
scene. This calibration procedure can easily and quickly be 
performed at any time a user wishes or at regular interval of 
time set by a microprocessor. The procedure further have the 
advantage that it only uses hardware components already present 

15 in the embodiment and does not require additional components, 
such as movement sensors, which would add to the cost, energy 
consumption or size of the embodiment. 

The invention also relates to an apparatus for performing 
the method according to the invention. This apparatus 

2 0 correspond in general to the known solid state imaging devices 
known by the skilled person but with the exception that the 
optical sensor is arranged in a flexible system comprising 
means for moving said sensor a predetermined or measurable area 
which are much less than each of the areas of each sensor 

25 element. When the sensor is arranged in a flexible system will 
the apparatus quickly and accurate be able to make new 
measurements and output values for each predetermined or 
measured position. 

The apparatus can also comprise a computer provided with a 

30 software program for establishing a representation of the high 
resolution image by calculating the representation of the 
received incident light from the scene at each subarea. The 
light sensor can preferably be moved by means of an electro- 
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mechanical device or a piezo-element , so that the position of 
the sensor-matrix can be controlled electrically, and thus the 
position synchronized to the storing and calculating electronic 
devices . 

5 A further advantage of the invention, is that each set of 

output values from the sensor matrix can be transmitted or 
stored externally together with information about the exact 
position of the sensor array at the time of the scanning, for 
calculation in another place or time, for example after 

10 transmission through network or storing on digital media. This 
will give the advantage that no extra computer resources for 
calculation has to be included in the invented apparatus, but 
existing resources in the receiving devices can be used. 

Referring now to the drawing figures. Fig. 1 shows a 

15 sensor cell 1 with 16 equally sized subareas a moved from a 
first scanning position 2 to a second scanning position 3 . As 
can be seen there is T = 6 overlapping subareas, which means 
that the total area N of the overlapping subareas is N=6*a 
while the entire sensor area A = 16*a. That means that if the 

2 0 sensor is moved in such a way that the overlapping area only is 
increasing by the size a of a subarea during each scanning the 
resolution can as maximum be extended by the size A. 

Fig. 2a illustrates how the original picture 4, consisting 
of two black squares 5 and two white squares 6, are being 

2 5 processed by the method according to the invention. The black 

squares are given the value 0 while the white squares are given 
the value 2 56, which are the normal value range used in 
computer and sensor systems. The sensor is having a cell-array 
7 with 6 cells, and in the next line is seen how the sensor 

3 0 according to the invention is evaluating the image. Each cell 

is larger than each square in the image. The sensor will 
therefore not be able to see the correct image resolution. 
Since each cell only is able to see a number of squares, will 
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each cell give a mean value from the squares. In this case is 
the first set of squares 5a and 6a and the second set of 
squares 5b and 6b each given the respective cells mean value of 
128 (in the Figs. This is indicated by single-lined right 
5 inclined hatching) . Therefore, image 8 would be the resulting 
image in case the image is not further processed. 

Fig. 2b shows how the sensor is making a first scanning 
9a, then moving the sensor in the X-direction with a step a, 
and thereafter making a second scanning 9b. The incoming 

10 output signals from the sensor cells is stored in the 
electronics attached to the sensor (directly or indirectly) as 
respectively a first and second set of signals based on each 
cells incoming light. The first set of output signal from the 
sensor is measured as respectively Vo(l,l), Vo(l/2), Vo(l,3), 

15 Vo(l,4), Vo(l,5), Vo(l,6), and the second set of output signals 
are measured as respectively Vo(2,l), Vo(2,2), Vo(2,3), Vo(2,4), 
Vo(2,5), Vo(2,6). The o stands for output, s for sensor, the 
numbers denotes the scan number and the cell number 
respectively. The new set of calculated la light values are 

20 denoted respectively Ia(l,l), Ia(2,l), Ia(l,2), Ia(2,2), 
lad, 3), Ia(2,3), lad, 4), Ia(2,4), lad, 5) Ia(2,5), Ia(l,6). The 
numbers in the brackets denotes the a value ( = 1 or 2) and the 
cell number in the original sensor matrix that it originates 
from, respectively . 

25 The new picture, which is shown in Fig. 2c, is now 

calculated by means of the formula (3), as the subareas are 
equally sized. 

I^(z) = Vo*N - Ila(n) for n=l to n=N, a;tz 

30 

where : 

N is the number of subareas into which each cell is split, 
n is the index for subareas in the sensor cell, 
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a is the area of a subarea of the sensor cell, 
Vo is the output signals from the sensor cells, 
la is the computed light radiation received by the subarea a, 
z is the subarea to be used for calculation, and 
5 A is the area of the sensor cell. 

The resolution enhancement factor is in the present case 2, and 
for each cell is there a overlapping area T of 1. 

10 la(l.l) = Vo(l,l)*2 - Ila(a) 

in this specific case is Sla(a) not known, as no values has 
been previously calculated, why an estimate is given, e.g. the 
mean value of the starting cell, that is Zla(a)= Vo(l,l), 
15 therefore: 
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Fig. 3 shows how the method according to the invention is 
30 operation in case each sensor cell is not abutting on the next 
sensor cell. The image seen in Fig. 3a is the same image as 
that seen in Fig. 2a, however the sensor cells 7 are seeing the 
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image differently as there is a space b between the cells. 
Therefore, image 10 would be the resulting image in case the 
image is not further processed. 

Fig. 3b shows how the space can be covered by three 
5 scannings, because the distance between two cells is exactly 
half the width of a cell. The resulting resolution enhancement 
will in this case not be equal to N (which is two) as the 
scannings cover an area which where not covered by the sensor 
matrix, thereby giving a resolution enhancement of 3. The 

10 sensor is making a first scanning 10a, then moving the sensor 
in the X-direction with a step a, and thereafter making a 
second scanning 10b, moving the sensor in the X-direction with 
step a and making a third scanning 10c. The incoming input 
signals is stored in the sensor electronics attached to the 

15 sensor directly or indirectly as respectively a first, a second 
and a third set of signals based on each cells incoming light. 

The first set of output signal from the sensor is 
measured as respectively Vo{l,l), Vo(l,2), Vo(l,3), Vq ( 1 , 4 ) , 
Vo(l,5), Vo(l,6), and the second set of output signals are 

2 0 measured as respectively Vo(2,l), Vo(2,2), Vo(2,3), Vo(2,4), 
Vo(2,5), Vos(2,6) and the third set of output signals are 
measured as respectively Vo(3,l), Vo(3,2), Vo(3,3), Vo(3,4), 
Vo(3,5), Vo(3,6). The o stands for output, the numbers denotes 
the scan number and the cell number respectively. A third 

2 5 number would have to be introduced in case of a sensor matrix 
with more than one row. 

The new set of calculated la light values are denoted 
respectively Ia(l,l), Ia(2,l), Ia(3,l), Ia(l,2), Ia(2,2), 

Ia(3,2), lad, 3), Ia(2,3), Ia(3,3), la ( 1 , 4 ) , Ia(2,4), Ia(3,4), 

30 lad, 5), Ia(2,5), Ia(3,5), lad, 6). The numbers in the brackets 
denotes the n value ( = 1, 2 or 3) and the cell number in the 
original sensor matrix that it originates from, respectively. A 
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third number would have to be introduced in case of a sensor 
matrix with more than one row. 

The new picture, which is shown in Fig. 3c, is now 
calculated by means of the formula (3) as the subareas of the 
5 sensor cell are equally sized. 



Ia(z) = Vo*N - Ela(n) for n=l to n=N, a^z 



where : 

10 N is the number of subareas into which each cell is split, 
n is the index for subareas in the sensor cell, 
a is the area of a subarea of the sensor cell, 
Vo is the output signals from the sensor cells, 
la is the computed light radiation received by the subarea a, 

15 z is the subarea to be used for calculation, and 
A is the area of the sensor cell. 
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In both cases, an estimate of the initial value of la (1/1) 
is made. In case this estimate is wrong or contains an error, 
the mistake will propagate throughout the calculations. Fig. 4 
5 shows how one embodiment of the digital filter according to the 
invention is used for correcting an error. The original 
picture 11 in (4) has a grey background (in the figs, indicated 
by single-lined right inclined hatching) with value 128 and two 
grey dots (12a, 12b) with value 64 (this is indicated in the 

10 Figs, by small cross-hatching). With one scan 13 the resulting 
picture would be 14. According to the invention two scans 
15a, 15b are used in this example to double the resolution, A=2 . 
The sensor cells measure the grey background correctly with 
values 128, but the output Vo(2,2) (output from scan 2, sensor 

15 cell 2) is due to a distortion or other error, measured as 80 
instead of 96, which would be the correct value. This will 
cause all the calculated new values after la (1,2) to be 
incorrect 16, which can be seen by the following calculation: 
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Vo(l,5) 


*2- 


Ia(2,4) = 


30 Ia(2,5) = 


Vo{2, 5) 


*2- 


lad, 5) = 


lad, 6) = 


Vod, 6) 


*2- 


Ia(2, 5) = 



128*2-128 =128 (Estimated initial 

128*2-128 =128 
128*2-128 =128 
80*2-128 =32 
96*2-32 =160 
96*2-160 =32 
96*2-32 =160 
128*2-160 =96 
96*2-32 =160 
128*2-160 =96 
96*2-32 =160 
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It is obvious that the error introduced in Vo(2,2) will 
influence all the following calculations, and will cause an 
oscillation even when Vq has stopped changing. This is shown in 
the resulting picture 16a. In the calculations of the la 
5 values in 16b a very simple digital filter according to (4) has 
been introduced. This digital filter has the advantage that it 
can use more values from previous measured and/or calculated 
cells to calculate new la values, thereby minimizing the 
influence of noise and other errors: 

10 

The filter coefficients are chosen to: 



Fv=2 

F (-1, 0) =0 . 75 

15 F(-2,0)=G.25 (only one row in the sensor matrix) 
All other coefficients in (4) are set to 0. 



Ia(l,l) = Vo(l,l)*2- Vo(l,l) 

128*2-128 

20 = 128 (Estimated initial value) 

la (2, 1) = Vo(2, 1) *2-0 . 75*Ia(l, 1) -0.25*Ia(l, 1) 

2* 12 8-0. 75* 12 8+0. 25* 12 8 
128 

da (1,1) are used two times, as no present value exist) 
25 la (1/2) = Vo(l,2) *2-0.75*Ia(2, 1) -0.25* la (1,1) 

2*128-0 . 75*12 8+0 .25*128 
128 

la (2, 2) = Vo(2,2) *2-0.75*Ia(l,2) -0 . 25*Ia (2 , 1 ) 

2*80-0 . 75*12 8+0 .2 5*128 
30 = 32 

lad, 3) = Vo(l,3) *2-0.75*Ia(2,2) -0.25* la (1,2) 

2* 96-0. 75*32 +0.25* 12 8 

136 
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Ia(2,3) 



lad, 4) 



Ia(2,4) 



10 Ia(l/5) 



Ia(2,5) 



15 



Ia(l/6) 



Vo(2,3) *2- 0.75* la (1,3) - 0 . 2 5* la (2 , 2 ) 
2*96-0 . 75*136+0 .2 5*32 
82 

Vo(l,4)*2-0.75*Ia(2,3)-0.25*Ia(l,3) 
2* 96 -0.7 5* 82+0. 25*136 
96 . 5 

Vo(2,4) *2-0.75*Ia(l,4) -0.2 5*Ia(2,3) 

2*128-0 . 75*96 . 5+0 .25*82 

163 

Vo(l,5) *2- 0.75* la (2, 4) - 0 . 2 5* la ( 1 , 4 ) 

2*128-0 . 75*163+0 .2 5*96 . 5 

109.5 

Vo(2,5) *2- 0.75* la (1,5) -0 . 25*Ia (2 , 4 ) 

2*128-0 . 75*109 . 5+0 .2 5*163 

133 

Vo(l, 6) *2-0 .75*Ia(2, 5) -0 . 25*Ia ( 1 , 5) 
2* 12 8-0. 75*109. 5+ 0.25*1 63 

129 



20 In Fig. 4, the different values in accordance with the 

calculation above are indicated by means of different types of 
hatching. As can be seen from this example, the error 
introduced in the measurement of cell Vo(2,2) will not cause 
oscillations in the following calculations and the influence 

25 will disappear. The resulting picture can be seen in 16b. 

Fig. 5 illustrates in form of an apparatus 17 by way of 
example the basic principle for using the invention in a web 
camera. The apparatus 17 comprises a light sensor 18 with a 
number of cells 19 formed as a matrix. The sensor serves for 

3 0 receiving incident light radiated from a scene (not shown) . The 
light sensor is movable mounted on a frame 20. Two drivers 21 
are furthermore arranged for cyclically moving the light sensor 
along the frame in a X and Y direction. 



-19- 



The drivers could e.g. be a piezo-element or an electro- 
mechanical device. Each driver is associated with a position 
sensor 22 for recording the immediate position of the light 
sensor relative to the frame and for generating output 
5 representing said position. 

A computer 2 3 serves for receiving the generated output 
from the position sensors and for, by means of a software 
program, calculating control values which via a circuit 24 is 
send to the two position drivers 21 for bringing these to drive 

10 the light sensor 18 in such a way that the steps of movement as 
function of the scannings defines a predetermined curve in a 
coordinate system . 

The apparatus functions in principle in the way described 
above with reference to Figs. 1 - 16. In particular, the light 

15 sensor 18 is cyclically brought to scan the scene (not shown) 
by means of an activator (not shown) for a number of times. 
Simultaneously with the scanning the light sensor is stepwise 
moved an identical number of times along the frame in the X-Y 
direction while defining a number of subareas, whereby the 

20 total distance covered during said movements of the light 
sensor corresponds to the extend of the cell and the distance 
to the next cell in the X-Y direction, respectively. During 
the operation of the apparatus output representing the received 
incident light from the scene at each sensor cell is send from 

25 the light sensor 18 to the computer 23 via another circuit 25, 
which is shown in bold line. 

By storing the received output from the light sensor and 
adding information about the position of the sensor at the time 
of scanning by means of another software program, the computer 

30 can transmit the pictures and added information to another 
computer (not shown) by means of the circuit 2 6 which can be 
any kind of wired or wireless connection or network. The 
receiving computer at the other end of the network can then 
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establish a representation of the high resolution picture by 
calculating the representation of the received incident light 
from the scene at each subarea , 

The adding of information about the position together with 
5 the images, can be done in several ways. However, to avoid 
destroying the information when converting images from one file 
format to another, the information about the position of the 
sensor 18 at the time of scanning of the scene (not shown) is 
coded directly into the image by means of a software program in 
10 the embedded computer 25. The program advantageously uses some 
of the pixels in the scanned image and substitutes these with 
information about the position. The missing pixels will at the 
time of displaying be substituted with picture information by 
means of another software program. This can be done by means of 
15 different known interpolating software algorithms known by 
persons skilled in image processing. 

By this method, the information about the position of the 
sensor 18 will be consistent in the picture, even if 
transformation to other file formats takes place before the 
20 calculation of high-resolution pictures. 

The calculated representation of the high resolution 
picture can then be shown on different kind of displaying 
devices as computer screens and projectors. 

The above mentioned curve which is showing the steps of 
2 5 movement as function of the scannings in a coordinate system 
can within the scope of the invention in itself have any 
suitable form. In the following advantages and drawbacks of 
some representative curves are mentioned. 

In Figs. 6a and 6b a simple principle for moving a light 
30 sensor 26 is illustrated, which in this case is only moved in 
the Y-direction. It is, however, obvious that the movement as 
well could be in the X-direction. Fig 6b shows a coordinate 
system where the time of scanning is shown on the axis of 
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abscissas and the position of the light sensor on the axis of 
ordinate. The scannings are performed with equidistant time 
intervals and the distance between each position of the light 
sensor 26 is identical to these intervals. Thereby the movement 
5 of the light sensor as function of the scannings needs to 
precisely follow a triangle curve as shown in fig. 6b. 

Fig. 7a illustrates a sensor matrix 27 moved in the 
diagonal direction, which is simple to control merely 
mechanical since the movements only take place in one 

10 direction. The subsequent calculations are, on the other hand, 
relatively complicated as the subareas are having different 
sizes, which need to be converted by means of interpolation to 
equal quadratic pixels elements before being able to show the 
high resolution picture on e.g. a television screen. 

15 As shown in Fig. 7b, the scanning positions are 

asynchronous with scanning times. That means that each new 
scanning is taken place in a matrix position not scanned before 
whereby an almost infinite high resolution is possible by only 
scanning a sufficient number of times. The distances between 

20 the positions of the sensor matrix and the scanning times, 
respectively, are as in the example shown in Figs. 6a and 6b 
equidistant thereby requiring that the curve shown in Fig. 7b 
must be a triangle. 

In Fig. 8a, the sensor matrix 28 is carrying out free 

25 oscillations which is the most simple way for mechanically 
moving the sensor. The oscillations shall, however, still be 
controlled in such a way that they are kept within the wanted 
limitations. Fig. 8b shows a situation where the distance 
between the scannings is equal in time whereby the distances 

30 between the positions of the sensor matrix 28 will be different 
resulting in complicated subsequent calculations and reduced 
precision of this calculations. 
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Figs. 9a and 9b show the same as in Figs. 8a and 8b, with 
the only difference being that the distances between the 
positions of the sensor matrix now are constant whereas the 
distance in time between the scannings is varying. This mode of 
5 using the invention requires in many cases a picture buffer as 
most receivers, such as computers or servers or the like will 
require that the pictures arrives with equal distances in time. 

Figs. 10a, 10b and 10c illustrate the invention used in a 
scanner. In a scanner a sensor matrix having three arrays 
10 usually is used. Each array having a red (R) , green (G) or blue 
(B) filter. All colors are scanned in one scan (single pass) 
while a step motor is moving the three arrays over the object 
to be scanned . 

Some scanners are using only one array. In this case will 

15 the filter be changed between each scan, i.e., that the array 
shall pass the object three times (a multipass process) . The 
resolution in a scanner depends upon the number of elements in 
the array and the precision of movement of the arrays. 
Typically, the resolution in the movement direction of the 

20 array will be the double the resolution in the direction of the 
array itself, conventionally 300x600 dpi or 600x1200 dpi. The 
distances between each pixel cause this, which typically is in 
the same order of magnitude as the pixel itself, whereby a 
higher resolution is possible in the Y-direction where the step 

25 motors can move in steps of precisely one pixel. 

By using the invention in a scanner, the size of the pixel 
will not any more be the restricting factor as the array can be 
moved in the X-direction by means of an arrangement similar to 
the arrangement shown in Fig. 6a. The movement in the Y- 

30 direction can be carried out by means of a step motor, but in 
even smaller steps independent of the size of the pixels 
whereby the wanted resolution can be obtained. This 
arrangement is shown in Fig. 10 showing a scanner 2 9 having 
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three arrays 30, 31 and 32 of cells R (red) , G (green) and B 
(blue) . 

One driver 33 is typically arranged for cyclically moving 
the arrays in the X-direction. The driver is associated with a 
5 position sensor 34 for recording the immediate position of the 
light sensor in the X-direction and for generating output 
representing said position. 

A computer 3 5 serves for receiving the generated output 
from the position sensors and for, by means of a software 

10 program, calculating control values which via a circuit 3 6 is 
send to the position driver 33 for bringing this to drive the 
three arrays cyclically in a wanted mode along the X-axis as 
illustrated in Fig. 10b, while the three arrays is moved along 
the Y-axes by means of a stepmotor as illustrated in Fig. 10c. 

15 Fig. 11 shows another advantageous embodiment of the 

apparatus according to the invention. The apparatus comprise a 
light sensor 18 with a number of cells 19 formed as a matrix. 
The sensor serves for receiving light radiated from a scene 
(not shown) . The light sensor is mounted on a sensor frame 20, 

20 such as a printed circuit board or similar. The frame is 
further movably mounted on a base frame 37, such as a circuit 
board or similar, by means of a resilient mountings 38, such as 
rubber suspensions, springs or the like. 

Two drivers, implemented as coils 39, are rigidly mounted 

25 on the base frame, and corresponding anchoring means 40, which 
for example consist of a ferromagnetic material which is 
mounted on the sensor frame, which sensor frame is moveable, is 
mounted on the base frame. When applying electrical energy, in 
terms of current and voltage, to these coils 39 a magnetic 

30 field will be induced, which will attract the anchors 40 
mounted on the sensor frame, thereby moving the sensor frame in 
the x respective y direction, where the distance moved will be 
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dependent on the amount of electrical energy applied to the 
individual coil 39. 

An embedded computer 23 serves for, by means of a software 
program to calculate control values in terms of current and 
5 voltages which via a third circuit 41 is sent to the two coils 
3 9 bringing these to move the light sensor 18 mounted on the 
sensor frame 3 7 in steps, where a predetermined curve in a 
coordinate system is defined by the steps as a function of the 
scanning . 

10 The steps is measured with a precision of microns, it is 

therefore necessary to be able to move the sensor very 
precisely in fractions of the size of the individual sensor 
elements, or to obtain precise information about the position 
of the sensor. In the present invention the precise movement of 

15 the apparatus is achieved by measuring the position of the 
sensor frame 20 and thereby the sensor 18 at different 
predetermined sets of the applied values of current and 
voltage. This is usually only done once in a calibration 
procedure . 

2 0 The embedded computer 2 3 applies a number of known values 

of energy, in terms of current and voltage to the coils 39, 
which will move the sensor frame in an equal number of 
displacement positions. For each applied value of energy the 
displacement of the sensor frame is compared to a reference 
25 position, which is the position of the sensor frame where no 
energy is applied. Each value of energy is measured and stored 
in the embedded computer 23. The measurement of the 

displacement is done by means of the sensor 18. For each new 
value of energy applied to the coils, a signal representing the 

3 0 scene (not shown) obtained by the sensor 18 is sent to the 

embedded computer 23 through a fourth circuit 42. 

The embedded computer stores every representation of the 
scene and the matching energy value. Alternatively the embedded 
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computer sends the representation and matching energy values 
to be stored in an external computer 43, which is connected to 
the embedded computer 23 through any kind of network 44. By 
means of a software program the embedded computer 2 3 or the 
5 external computer 43 analyses and compare the different 
representations of the scene obtained by the sensor 18 in the 
different positions. The program then calculate how many pixels 
the sensor frame 2 0 have moved by comparing different values of 
applied energy to the coils 39 with the different signals 

10 representing the scene (not shown) , thus finding the 
displacement of the sensor frame 2 0 and the sensor 18, thereby 
enabling the embedded computer 23 to move the sensor frame 2 0 
and thereby the sensor 18 any predetermined distance after the 
calibration procedure has taken place. Normally this 

15 calibration procedure only needs to take place once. 
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